Delaying execution in a processor to increase power savings

ABSTRACT

Embodiments relate to storing data in memory. An aspect includes applying a power savings technique to at least a subset of a processor. Pending work items scheduled to be executed by the processor are monitored. The pending work items are grouped based on the power savings technique. The grouping includes delaying a scheduled execution time of at least one of the pending work items to increase an overall number of clock cycles that the power savings technique is applied to the processor. It is determined that an execution criteria has been met. The pending work items are executed based on the execution criteria being met and the grouping.

DOMESTIC PRIORITY

This application is a continuation of U.S. patent application Ser. No.14/245,301, filed Apr. 4, 2014, the content of which is incorporated byreference herein in its entirety.

BACKGROUND

The present invention relates generally to computer systems, and morespecifically, to delaying execution in a processor in order to increasepower savings potential.

In computer systems with multiple interconnected components (e.g.,processors, accelerators, memory) it is often the case that somecomponents are busy while others are idle. A standard method of reducingpower usage by components during inactive intervals is to use powergating to activate sleep or power down modes. According to this method,the logic is built of low-threshold transistors, with high-thresholdtransistors serving as a footer or header to cut leakage during thequiescence intervals. During normal operation mode, the circuits achievehigh performance, resulting from the use of low-threshold transistors.During sleep mode, high threshold footer or header transistors are usedto cut off leakage paths, reducing the leakage currents by orders ofmagnitude. Another method of reducing the active power is transparentclock gating (TCG). TCG takes advantage of bubbles in a pipeline toavoid clocking latches when a pair of data items are separated by morethan one clock cycle (i.e. not back-to-back), potentially reducing clockpower by fifty percent in some units for normal workloads.

A general drawback associated with such techniques of power savings isthat periods of idleness (or pipeline bubbles) for a given resource areoften not long enough to support the overhead associated with activatingand deactivating the power savings technique, even when the fraction ofidle cycles relative to the total number of execution cycles is ratherlarge.

SUMMARY

Embodiments include computer implemented methods, systems and computerprogram products for storing data in memory. A method includes applyinga power savings technique to at least a subset of a processor. Pendingwork items scheduled to be executed by the processor are monitored. Thepending work items are grouped based on the power savings technique. Thegrouping includes delaying a scheduled execution time of at least one ofthe pending work items to increase an overall number of clock cyclesthat the power savings technique is applied to the processor. It isdetermined that an execution criteria has been met. The pending workitems are executed based on the execution criteria being met and thegrouping.

Additional features and advantages are realized through the techniquesof the present embodiment. Other embodiments and aspects are describedherein and are considered a part of the claimed invention. For a betterunderstanding of the invention with the advantages and features, referto the description and to the drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

The subject matter that is regarded as the invention is particularlypointed out and distinctly claimed in the claims at the conclusion ofthe specification. The foregoing and other features, and advantages ofthe invention are apparent from the following detailed description takenin conjunction with the accompanying drawings in which:

FIG. 1 illustrates a block diagram of a system in accordance with anembodiment;

FIG. 2 illustrates block diagrams of various sequences of activity bitsin accordance with embodiments;

FIG. 3 illustrates a block diagram of a central processing unit that isconfigured to delay instruction execution in accordance with anembodiment;

FIG. 4 illustrates a process flow for delaying instruction execution inaccordance with an embodiment;

FIG. 5 illustrates a block diagram of a system that includes powermanagement in accordance with an embodiment; and

FIG. 6 illustrates a process for rescheduling off-chip memory accessesin accordance with an embodiment.

DETAILED DESCRIPTION

Embodiments of the present invention relate to delaying non-criticalinstructions in order to increase power gating efficiency. In anembodiment, the issuance of ready instructions in an issue queue can bedelayed when there are less than a specified number of readyinstructions in the issue queue and when the ready instructions havebeen waiting for less than a specified maximum number of clock cycles.This can allow the idle period for the resource that executes the readyinstructions to be elongated. In addition, pending requests to off-chipmemory can be delayed and sent in bursts. In addition, data being sentthrough a pipeline can be grouped and non-critical data items delayed totake advantage of transparent clock gating (TCG).

Referring now to FIG. 1, a block diagram of a computer system inaccordance with embodiments is generally shown. The computer systemincludes a multiprocessor chip 102, an accelerator chip 104, and memorydevices 114. As used herein, the term “chip” refers to an integratedcircuit, i.e., a set of electronic circuits on one small plate (chip) ofsemiconductor material (e.g., silicon). As shown in FIG. 1, themultiprocessor chip 102 can include one or more cores 106 (also referredto as “core processors”) and corresponding level two (L2) caches 108,one or more level three (L3) caches 110, and one or more memorycontrollers 112. The memory controller 112 can connect to the memorydevices 114 and the accelerator chip 104 via one or more memory links.The multiprocessor chip 102 shown in FIG. 1 is a multi-core processorthat is implemented by a single computing component with two or moreindependent actual central processing units (CPUs) (referred to as“cores 106” in FIG. 1). The cores 106 can include level one (L1) cache,and they can read and execute program instructions (e.g. via executionunits). The instructions can include ordinary CPU instructions such asadd, move data, and branch, but the multiple cores 106 can run multipleinstructions at the same time, increasing overall speed for programsamenable to parallel processing. Embodiments described herein can beimplemented by program instructions executing on the multiprocessor chip102.

As shown in FIG. 1, the accelerator chip 104 can be implemented, forexample, by a hybrid memory cube (HMC). The accelerator chip 104 caninclude memory controllers 112 that are connected, via memory links tomemory devices 114.

The memory devices 114 can be implemented by, but are not limited to: acombination of various types of computer readable storage media, such asa hard disk, a random access memory (RAM), a read-only memory (ROM), anerasable programmable read-only memory (EPROM or Flash memory), anoptical fiber, and the like, to store executable instructions andassociated data.

Referring now to FIG. 2, a sequence of activity bits 202 (each bitrepresenting a clock cycle) of an execution unit, or unit, operating ona core 106 is generally shown. Examples of units include, but are notlimited to: an arithmetic logic unit (ALU), a multiply/add-accumulateunit (MAAC), and a control unit (CU). The power gating potential of aunit depends on the idle interval size as well as the number of idleintervals. The sequence of activity bits 202 shown in FIG. 2 has threeidle intervals. As shown in legend 206, activity bits labeled “1”indicate active cycles and “0” indicate idle cycles. Assuming anoverhead value of three cycles for activating a power gating mode(includes several overhead values, like for example, the activation ofthe header or footer transistor, among others), the unit can be powergated for up to six (calculated as (5-3)+(4-3)+(6-3)) cycles out of atotal of fifteen idle cycles, thereby achieving a forty percent powergating potential (calculated as 6/15).

Also, in dealing with such small duration idle sequences, theperformance overhead could be large. For example, if we assume a latencyof one cycle to deactivate a power gating mode (Twakeup penalty), thenthere would be three additional cycles added to the execution time. Thiswould represent a nine point four percent (calculated as 3/32)performance overhead. More power savings with less performance overheadcould be achieved if the idle duration times were made longer.

An embodiment described herein increases the power gating potential of aunit by delaying the execution of non-critical operations. In theexample shown in FIG. 2, it is assumed that the “1 s” that are containedin a circle are critical and cannot be delayed without impactingperformance. It is also assumed that the “1 s” that are not contained ina circle are not critical and could be delayed, for a short period,without impacting performance. In an embodiment, the operations can begrouped (e.g., by a compiler, by hardware issue logic) to achieve anexecution profile such as that indicated by the modified sequence ofactivity bits 204 shown in FIG. 2. In the modified sequence of activitybits 204, the power gating interval is twelve cycles (calculated as(15−3)), with a three point one percent performance overhead (calculatedas 1/32) assuming a Twakeup penalty of one cycle. This translates into anew PGE of eighty percent (calculated as 12/15) when three cycles arerequired each time the power gate is activated.

Also shown in FIG. 2 a sequence of activity bits 208 representing dataitems being sent to a pipeline within a unit (e.g., a MAAC) in a core106 is generally shown. The TCG potential of a unit can depend on theidle interval size as well as the number of idle intervals. For example,the sequence of activity bits 208 shown in FIG. 2 has alternating idleand active intervals. A data item propagating through a normally clockedpipeline would require “S” clock cycles, where S is the number ofpipeline stages. A data item “D1” propagating through a TCG pipeline isclocked only floor(S/c), where “c” is the number of cycles separatingdata item D1 from the next upstream data item “D2.” In sequence ofactivity bits 208, where S=3, a normally clocked pipeline would requiretwenty-one clocks (calculated as 7 active bits multiplied by 3 stages)to be generated. In contrast, a TCG pipeline would require only twelveclocks (calculated as 4*floor( 3/1)+2*floor(¾)+1*floor(¾)=12+0+0=12) tobe generated. However, embodiments described herein can further improvethe clocking in a TCG pipeline by altering the spacing between adjacentdata items. As shown in sequence of activity bits 210, the second,third, fifth, and sixth data items can each be delayed by one clockcycle. In this example, the normally clocked pipeline still requirestwenty-one clocks, but the TCG pipeline now only requires six clocks(calculated as 6*floor( 3/2)+1*floor(¾)=6+0=6) to be generated. Bygrouping and delaying some of the data items (thus rearranging thebubbles in the pipeline), for the sequence of activity bits 208, the TCGpipeline can thus reduce its clocking requirements by fifty percentwhile still providing the same data throughput (note that the number ofclock cycles between the first and last data item is not changed).

Turning now to FIG. 3, a central processing unit that is configured todelay instruction execution is generally shown in accordance with anembodiment. Shown in FIG. 3 is a core 106 that includes a delayexecution mechanism 304, an issue queue 302, and execution units 306. Inan embodiment, the delay execution mechanism 304 can be implemented atthe instruction issue stage to: monitor the issue queue 302 and toenable/disable issuing; and to actuate clock/power gating when issuingis delayed. In addition, the delay execution mechanism 304 cancommunicate with the issue queue 302 to monitor a number of readyinstructions in the issue queue 302 and an average age (e.g., averageindex of ready instruction) of the ready instructions in the issue queue302.

Turning now to FIG. 4, a process flow for delaying instruction executionis generally shown in accordance with an embodiment. The processingshown in FIG. 4 can be implemented by the delay execution mechanism 304executing on a core 106 such as, but not limited to a super scalar,out-of-order processor. As shown in FIG. 4, an issue queue 302 feedsinstructions to an execution unit 306, and the number of readyinstructions in the issue queue 302 as well as a wait time the issuequeue 302 can be used as proxies to decide when to delay. The processstarts at block 402, with a mechanism located in, or accessed by, theissue queue 302 (e.g., the delay execution mechanism 304) keeping trackof the number of ready instruction in the issue queue 302. Readyinstructions, as known in the art, are those instructions that are readyto be issued (e.g., all dependencies have been resolved). At block 404it is determined whether the number of ready instructions in the issuequeue 302 is less than a threshold number. If the number of readyinstructions in the issue queue 302 is not less than the thresholdnumber as determined at block 404, the processing continues at block 410where the issue queue 302 starts issuing the ready instructions to anexecution unit 306. It is determined, at block 412, if the issue queue302 is empty, if it is not empty, then processing continues at block410. In an embodiment the loop of blocks 410-412 can be continued untilthe issue queue 302 is empty. Once the issue queue 302 is empty, asdetermined at block 412, processing can continue at block 404. Thus,once the issue queue 302 starts to issue instructions it can continueuntil the issue queue 302 is empty.

In an embodiment, the threshold can be programmable and/or modifiedduring system operation based on factors such as workload, performance,quality of service, and other metrics. When the number of readyinstructions in the issue queue 302 reaches the threshold, theinstructions can be issued to execution pipes in the execution units306. With this approach, the ready instructions will be clustered forexecution instead of issuing independently in different times, thuspossibly creating a long idle interval from execution unit point ofview.

Still referring to FIG. 4, if it is determined at block 404, that thenumber of instructions in the issue queue 302 is less than the thresholdnumber, then processing continues at block 406. Block 406 is performedto mitigate possible performance losses due to critical instructionsbeing in a ready status in the issue queue 302. Critical instructionscan be those which have several other instructions dependent on themthat may get delayed for execution by waiting for the number of readyinstructions in the issue queue 302 to reach the threshold number. Thesecritical instructions can be identified by determining if any of theready instructions in the issue queue 302 have been waiting longer thana maximum number of cycles reflected in a wait time threshold number. Ifit is determined, at block 406, that any of the ready instructions havebeen waiting longer than the specified wait time threshold, thenprocessing continues at block 410, where the issue queue 302 begins toissue the ready instructions. If it is determined, at block 406, thatthe ready instructions in the issue queue 302 have been waiting lessthan the maximum number of cycles, then processing continues at block408 and the instructions continue to be held in the issue queue 302.Processing continues at block 404. Thus, the issue queue 302 does notstart issuing the ready instructions until one of two things happen: anumber of ready instructions in the issue queue 302 reaches thethreshold number or a ready instruction has been in the issue queue 302for longer than a maximum threshold number of clock cycles.

In an embodiment, the processing at block 410 can also include removing(or requesting removal of) power gating and/or clock gating from theexecution unit 306. In an embodiment, if it is determined at block 412,that the issue queue 302 is empty, a power gate and/or clock gate isactivated (or requested to be activated) for the execution unit 306. Asused herein the term power gating refers to using a header or footertransistor to cut off the power supply for the unit 306 to reduce bothits dynamic and leakage power dissipation. As used herein the term clockgating refers to disabling the clock of unit 306 to reduce its dynamicpower dissipation.

In an embodiment, block 406 of FIG. 4 can be skipped resulting inissuance decisions being made solely on a number of ready instructionsin the issue queue 302.

In an embodiment, the processing shown in FIG. 4 is performed for eachexecution unit 306 connected to the issue queue 302 and the processingtakes into account a target execution unit 306 and keeps track of countsand wait times for different execution units separately 306. Thus,instructions may be issued from the issue queue 302 for one executionunit 306 while being held for another execution unit 306. In addition,different thresholds may be utilized for the different execution units.

Similar to the power gating example shown above, there are severaltechniques to delay execution for TCG. The concept and techniques arethe same both for power gating and TCG, with the only difference beingthat the algorithms are tuned to separating the instructions in the TCGcase, rather than clustering the instructions as in the power gatingcase. For example, an embodiment of a technique can use information froman issue queue 302 in an out-of-order processor to delay execution ofinstructions based on a power/performance tradeoff. For example, when anon-critical instruction is ready to issue the cycle after anotherinstruction has been issued, the non-critical instruction can be delayedby one or more cycles.

Another technique utilized by embodiments is to distribute instructionsto different units in a round-robin fashion when there are not enoughinstructions ready to issue to fill up all units so that additionalbubbles are created.

In another embodiment, for cache pre-fetch engines, delays can beinserted between sequential pre-fetches to create bubbles in thepre-fetch and cache/memory pipelines without much impact to performance.In in-order or very long instruction word (VLIW) machines, the compilercan group instructions based on criticality information such that unitswill see more bubbles. Compilers may be able to achieve this to somedegree even in out of order execution machines. In low power modes ofoperation or power emergencies, bubbles can also be inserted morejudiciously even between critical instructions.

Referring now to FIG. 5, a block diagram of a computer system thatincludes power management in accordance with an embodiment is generallyshown. The computer system includes a multiprocessor chip 502 and memorydevices 516. As shown in FIG. 5, the multiprocessor chip 502 can includea power management controller (PMC) 504, one or more cores 508 (alsoreferred to as “core processors”) and corresponding L2 caches 510, oneor more L3 caches 512, and one or more memory controllers 514. Thememory controller 414 can connect to the memory devices 516 via one ormore memory links. Embodiments described herein can be implemented byprogram instructions executing on the multiprocessor chip 102. The PMC504 shown in FIG. 5 is connected to the cores and can send power savingsmode instructions to the cores 508. In addition, the PMC 504 shown inFIG. 5 is connected to the power controllers 506 located in the memorycontroller 514 for receiving power management data.

In an embodiment, the power controllers 506 in the memory controllers514 can include computer instructions to delay off-chip requests tomemory devices 516. The power controllers 506 can send pending requestsin bursts, and when a power controller 506 initiates a burst it cannotify the PMC 504. The PMC 504 can then decide to activate a core-levelpower savings mode such as, but not limited to dynamic voltage andfrequency scaling (DVFS) and per-core power gating (PCPG). In addition,the power controllers 506 can notify the PMC 504 when memory responsesbegin to arrive to allow the PMC 504 to begin a wake-up process for thecores 508 in advance.

Referring now to FIG. 6, a process for rescheduling off-chip memoryaccesses to increase low-activity periods at the core level is generallyshown in accordance with an embodiment. Processing starts at block 602and then moves to block 604 where it is determined whether a queueassociated with a memory controller 514 has been empty for more than athreshold number of cycles, “T_IDLE”. Block 604 continues to beperformed until it is determined that the memory controller queue (MCQ)has been empty for more than the threshold number of cycles. Once thisis determined, processing continues at block 606 where a link powersavings mode is initiated for memory links associated with the memorycontroller 514. In addition, the associated memory devices 516 can alsobe notified that nothing will be sent so that the memory devices 516 canenter a power savings mode. At block 608, it is determined whether thesize (number of entries) of the MCQ is greater than a threshold size,“T_SIZE.” If a number of entries in the MCQ are not greater than thethreshold, then block 620 is performed to determine whether a time sincethe last burst to the memory devices 516 is more than a threshold,“T_TIMER.” If the number of entries in MCQ is not greater than thethreshold T_SIZE and the time since the last burst is not greater thanthe threshold T_TIMER, then processing continues at block 608 tocontinue to test these two values. If either the number of entries inMCQ is greater than the threshold T_SIZE as determined at block 608 orthe time since the last burst is greater than the threshold T_TIMER asdetermined at block 620, the processing continues at block 610. At block610, the links between the memory controller 514 and the memory devices516 are activated. Next, block 612 is performed and the PMC 504 isnotified that the links are being activated. In an alternate embodiment,block 612 is skipped and the PMC 504 is not notified of the links beingactivated.

Processing continues at blocks 614-616 where all of the contents(requests) of the MCQ are sent to the off-chip memory devices 516 forprocessing. Once MCQ is empty, processing continues at block 618 wherethe time is cleared and processing continues at block 604.

Technical effects and benefits include delaying non-critical instructionexecution at the pipeline level which can lead to reduced power at theexecution units. In addition, rescheduling off-chip accesses to increaselow-activity periods at the core level can lead to reduced power at thecores, caches and interconnections.

The terminology used herein is for the purpose of describing particularembodiments only and is not intended to be limiting of the invention. Asused herein, the singular forms “a”, “an” and “the” are intended toinclude the plural forms as well, unless the context clearly indicatesotherwise. It will be further understood that the terms “comprises”and/or “comprising,” when used in this specification, specify thepresence of stated features, integers, steps, operations, elements,and/or components, but do not preclude the presence or addition of oneor more other features, integers, steps, operations, element components,and/or groups thereof.

The corresponding structures, materials, acts, and equivalents of allmeans or step plus function elements in the claims below are intended toinclude any structure, material, or act for performing the function incombination with other claimed elements as specifically claimed. Thedescription of the present invention has been presented for purposes ofillustration and description, but is not intended to be exhaustive orlimited to the invention in the form disclosed. Many modifications andvariations will be apparent to those of ordinary skill in the artwithout departing from the scope and spirit of the invention. Theembodiment was chosen and described in order to best explain theprinciples of the invention and the practical application, and to enableothers of ordinary skill in the art to understand the invention forvarious embodiments with various modifications as are suited to theparticular use contemplated.

The present invention may be a system, a method, and/or a computerprogram product. The computer program product may include a computerreadable storage medium (or media) having computer readable programinstructions thereon for causing a processor to carry out aspects of thepresent invention.

The computer readable storage medium can be a tangible device that canretain and store instructions for use by an instruction executiondevice. The computer readable storage medium may be, for example, but isnot limited to, an electronic storage device, a magnetic storage device,an optical storage device, an electromagnetic storage device, asemiconductor storage device, or any suitable combination of theforegoing. A non-exhaustive list of more specific examples of thecomputer readable storage medium includes the following: a portablecomputer diskette, a hard disk, a random access memory (RAM), aread-only memory (ROM), an erasable programmable read-only memory (EPROMor Flash memory), a static random access memory (SRAM), a portablecompact disc read-only memory (CD-ROM), a digital versatile disk (DVD),a memory stick, a floppy disk, a mechanically encoded device such aspunch-cards or raised structures in a groove having instructionsrecorded thereon, and any suitable combination of the foregoing. Acomputer readable storage medium, as used herein, is not to be construedas being transitory signals per se, such as radio waves or other freelypropagating electromagnetic waves, electromagnetic waves propagatingthrough a waveguide or other transmission media (e.g., light pulsespassing through a fiber-optic cable), or electrical signals transmittedthrough a wire.

Computer readable program instructions described herein can bedownloaded to respective computing/processing devices from a computerreadable storage medium or to an external computer or external storagedevice via a network, for example, the Internet, a local area network, awide area network and/or a wireless network. The network may comprisecopper transmission cables, optical transmission fibers, wirelesstransmission, routers, firewalls, switches, gateway computers and/oredge servers. A network adapter card or network interface in eachcomputing/processing device receives computer readable programinstructions from the network and forwards the computer readable programinstructions for storage in a computer readable storage medium withinthe respective computing/processing device.

Computer readable program instructions for carrying out operations ofthe present invention may be assembler instructions,instruction-set-architecture (ISA) instructions, machine instructions,machine dependent instructions, microcode, firmware instructions,state-setting data, or either source code or object code written in anycombination of one or more programming languages, including an objectoriented programming language such as Smalltalk, C++ or the like, andconventional procedural programming languages, such as the “C”programming language or similar programming languages. The computerreadable program instructions may execute entirely on the user'scomputer, partly on the user's computer, as a stand-alone softwarepackage, partly on the user's computer and partly on a remote computeror entirely on the remote computer or server. In the latter scenario,the remote computer may be connected to the user's computer through anytype of network, including a local area network (LAN) or a wide areanetwork (WAN), or the connection may be made to an external computer(for example, through the Internet using an Internet Service Provider).In some embodiments, electronic circuitry including, for example,programmable logic circuitry, field-programmable gate arrays (FPGA), orprogrammable logic arrays (PLA) may execute the computer readableprogram instructions by utilizing state information of the computerreadable program instructions to personalize the electronic circuitry,in order to perform aspects of the present invention.

Aspects of the present invention are described herein with reference toflowchart illustrations and/or block diagrams of methods, apparatus(systems), and computer program products according to embodiments of theinvention. It will be understood that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer readable program instructions.

These computer readable program instructions may be provided to aprocessor of a general purpose computer, special purpose computer, orother programmable data processing apparatus to produce a machine, suchthat the instructions, which execute via the processor of the computeror other programmable data processing apparatus, create means forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks. These computer readable program instructionsmay also be stored in a computer readable storage medium that can directa computer, a programmable data processing apparatus, and/or otherdevices to function in a particular manner, such that the computerreadable storage medium having instructions stored therein comprises anarticle of manufacture including instructions which implement aspects ofthe function/act specified in the flowchart and/or block diagram blockor blocks.

The computer readable program instructions may also be loaded onto acomputer, other programmable data processing apparatus, or other deviceto cause a series of operational steps to be performed on the computer,other programmable apparatus or other device to produce a computerimplemented process, such that the instructions which execute on thecomputer, other programmable apparatus, or other device implement thefunctions/acts specified in the flowchart and/or block diagram block orblocks.

The flowchart and block diagrams in the Figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods, and computer program products according to variousembodiments of the present invention. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof instructions, which comprises one or more executable instructions forimplementing the specified logical function(s). In some alternativeimplementations, the functions noted in the block may occur out of theorder noted in the figures. For example, two blocks shown in successionmay, in fact, be executed substantially concurrently, or the blocks maysometimes be executed in the reverse order, depending upon thefunctionality involved. It will also be noted that each block of theblock diagrams and/or flowchart illustration, and combinations of blocksin the block diagrams and/or flowchart illustration, can be implementedby special purpose hardware-based systems that perform the specifiedfunctions or acts or carry out combinations of special purpose hardwareand computer instructions.

The descriptions of the various embodiments of the present inventionhave been presented for purposes of illustration, but are not intendedto be exhaustive or limited to the embodiments disclosed. Manymodifications and variations will be apparent to those of ordinary skillin the art without departing from the scope and spirit of the describedembodiments. The terminology used herein was chosen to best explain theprinciples of the embodiments, the practical application or technicalimprovement over technologies found in the marketplace, or to enableothers of ordinary skill in the art to understand the embodimentsdisclosed herein.

What is claimed is:
 1. A computer implemented method comprising:applying a power savings technique to at least a subset of a processor;monitoring pending work items scheduled to be executed by the processor;grouping the pending work items based on the power savings technique,the grouping including delaying a scheduled execution time of at leastone of the pending work items to increase an overall number of clockcycles that the power savings technique is applied to the processor;determining that an execution criteria has been met; and executing thepending work items based on the execution criteria being met and thegrouping, wherein: the power savings technique is power gating, thepending work items are off-chip memory requests located in a queue, theexecuting includes a burst of contents of the queue to an off-chipmemory, the off-chip memory connected to the memory controller via amemory link, the power savings technique is applied to at least one ofthe processor, a memory located on the processor, the memory link, andthe off-chip memory, and the execution criteria includes at least oneof: a number of pending working items in the queue exceeds a thresholdnumber of pending work items and a number of cycles since a last burstis longer than a threshold amount of time.
 2. The method of claim 1,further comprising deactivating the power savings technique based on theexecution criteria being met.
 3. The method of claim 1, wherein the atleast one of the pending work items is a non-critical pending work item.4. A system comprising a processor, the system configured to perform amethod comprising: applying a power savings technique to at least asubset of a processor; monitoring pending work items scheduled to beexecuted by the processor; grouping the pending work items based on thepower savings technique, the grouping including delaying a scheduledexecution time of at least one of the pending work items to increase anoverall number of clock cycles that the power savings technique isapplied to the processor; determining that an execution criteria hasbeen met; and executing the pending work items based on the executioncriteria being met and the grouping, wherein: the power savingstechnique is power gating, the pending work items are off-chip memoryrequests located in a queue, the executing includes a burst of contentsof the queue to an off-chip memory, the off-chip memory connected to thememory controller via a memory link, the power savings technique isapplied to at least one of the processor, a memory located on theprocessor, the memory link, and the off-chip memory, and the executioncriteria includes at least one of: a number of pending working items inthe queue exceeds a threshold number of pending work items and a numberof cycles since a last burst is longer than a threshold amount of time.5. The system of claim 4, wherein the system is further configured todeactivate the power savings technique based on the execution criteriabeing met.
 6. The system of claim 4, wherein the at least one of thepending work items is a non-critical pending work item.
 7. A computerprogram product comprising: a computer readable storage medium havingprogram instructions embodied therewith, the program instructionsreadable by a processing circuit to cause the processing circuit toperform a method comprising: applying a power savings technique to atleast a subset of a processor; monitoring pending work items scheduledto be executed by the processor; grouping the pending work items basedon the power savings technique, the grouping including delaying ascheduled execution time of at least one of the pending work items toincrease an overall number of clock cycles that the power savingstechnique is applied to the processor; determining that an executioncriteria has been met; and executing the pending work items based on theexecution criteria being met and the grouping, wherein: the powersavings technique is power gating, the pending work items are off-chipmemory requests located in a queue, the executing includes a burst ofcontents of the queue to an off-chip memory, the off-chip memoryconnected to the memory controller via a memory link, the power savingstechnique is applied to at least one of the processor, a memory locatedon the processor, the memory link, and the off-chip memory, and theexecution criteria includes at least one of: a number of pending workingitems in the queue exceeds a threshold number of pending work items anda number of cycles since a last burst is longer than a threshold amountof time.
 8. The computer program product of claim 7, wherein the programinstructions further cause the processing circuit to deactivate thepower savings based on the execution criteria being met.
 9. The computerprogram product of claim 7, wherein the at least one of the pending workitems is a non-critical pending work item.